Multi-event type monitoring and searching

ABSTRACT

Multiple event types are monitored for events, and surveillance data is stored for each event. Surveillance data for a primary event of one event type can be presented to a user, and surveillance data for a set of related events corresponding to another event type can be presented based on a set of relatedness criteria and the surveillance data for the primary event. A user can adjust the relatedness criteria to filter/adjust the surveillance data presented for the related event(s). A user interface can enable the user to simultaneously view the surveillance data for both events and adjust the relatedness criteria. In an illustrative application, the invention is utilized to detect fraudulent merchandise returns in a retail store.

CROSS REFERENCE TO RELATED APPLICATION

Aspects of the invention are related to the co-owned, co-pending U.S.patent application Ser. No. 11/454,819, which is hereby incorporated byreference.

TECHNICAL FIELD

The disclosure relates generally to sensor-based monitoring, and moreparticularly, to analyzing events, such as human actions and retailevents.

BACKGROUND OF THE INVENTION

Fraud is a major concern in various industries. For example, in theretail industry, seeking to fraudulently obtain a refund for a purchaseditem is a common scheme employed by people. In the scheme, an individualmakes a valid purchase of an item and leaves the retail store.Subsequently, the individual returns to the retail store with thereceipt for the purchase, removes a similar item from the store shelves,and seeks to obtain a refund by presenting the receipt and the item justremoved from the store. If successful, the individual will be able tokeep the purchased item while obtaining a refund of the purchase price.Alternatively, without ever making a purchase, an individual may removean item from the store shelves and attempt to receive store credit forthe item at a return counter. Various other fraud schemes, such ascompensation claims for fraudulent injuries, also require individual(s)to perform preparatory actions on a premises that may be monitored(e.g., public place, parking lot, etc.).

Current fraud prevention solutions are very limited. In particular, todate, retail stores typically employ individuals as store detectivesand/or to monitor video surveillance in an attempt to prevent fraud.Further, video surveillance can be manually analyzed after the fraud hasbeen committed. However, the perpetrators may not be able to be locatedand/or the video may no longer available upon discovery of the fraud.

Separately, transaction data is often stored for a retail store. Thetransaction data can include various information on the purchases madeat the store (e.g., items purchased together, purchaser, payment method,cashier, cash register, date/time stamp, etc.). The transaction data canbe warehoused and exploited for department and/or associate performanceanalysis, stock control, and information about the shopping behaviors ofcustomers. Additionally, the transaction data can be used in a fraudinvestigation, but the transaction data is not fully exploited.Integration of surveillance video with transaction data is typicallylimited to copying timestamps from one system to the other, which maynot be synchronized between the systems.

SUMMARY OF THE INVENTION

Aspects of the invention provide a solution in which multiple eventtypes are monitored for events, and surveillance data is stored for eachevent. Surveillance data for a primary event of one event type can bepresented to a user, and surveillance data for a set of related eventscorresponding to another event type can be presented based on a set ofrelatedness criteria and the surveillance data for the primary event. Auser can adjust the relatedness criteria to filter/adjust thesurveillance data presented for the related event(s). A user interfacecan enable the user to simultaneously view the surveillance data forboth events and adjust the relatedness criteria. In an illustrativeapplication, the invention is utilized to detect fraudulent merchandisereturns in a retail store.

A first aspect of the invention provides a method of presentingsurveillance data for an area, the method comprising: providing primarysurveillance data for a set of primary events corresponding to one of aplurality of monitored event types for presentation to a user; obtaininga selected event from the set of primary events and a corresponding setof relatedness criteria; identifying a set of related eventscorresponding to another one of the plurality of monitored event typesbased on the surveillance data for the selected event and the set ofrelatedness criteria; and providing related surveillance data for eachrelated event for presentation to the user.

A second aspect of the invention provides a system for presentingsurveillance data for an area, the system comprising: a component forproviding primary surveillance data for a set of primary eventscorresponding to one of a plurality of monitored event types forpresentation to a user; a component for obtaining a selected event fromthe set of primary events and a corresponding set of relatednesscriteria; a component for identifying a set of related eventscorresponding to another one of the plurality of monitored event typesbased on the surveillance data for the selected event and the set ofrelatedness criteria; and a component for providing related surveillancedata for each related event for presentation to the user.

A third aspect of the invention provides a computer program comprisingprogram code stored on a computer-readable medium, which when executed,enables a computer system to implement a method of presentingsurveillance data for an area, the method comprising: providing primarysurveillance data for a set of primary events corresponding to one of aplurality of monitored event types for presentation to a user; obtaininga selected event from the set of primary events and a corresponding setof relatedness criteria; identifying a set of related eventscorresponding to another one of the plurality of monitored event typesbased on the surveillance data for the selected event and the set ofrelatedness criteria; and providing related surveillance data for eachrelated event for presentation to the user.

A fourth aspect of the invention provides a method of generating asystem for presenting surveillance data for an area, the methodcomprising: providing a computer system operable to: provide primarysurveillance data for a set of primary events corresponding to one of aplurality of monitored event types for presentation to a user; obtain aselected event from the set of primary events and a corresponding set ofrelatedness criteria; identify a set of related events corresponding toanother one of the plurality of monitored event types based on thesurveillance data for the selected event and the set of relatednesscriteria; and provide related surveillance data for each related eventfor presentation to the user.

A fifth aspect of the invention provides a user interface including: afirst panel for providing primary surveillance data for a set of primaryevents corresponding to one of a plurality of monitored event types; anda set of user interface controls for enabling a user to identify aselected event from the set of primary events and define a set ofrelatedness criteria; and a second panel for providing relatedsurveillance data for a set of related events corresponding to anotherone of the plurality of monitored event types based on the surveillancedata for the selected event and the set of relatedness criteria.

Other aspects of the invention provide methods, systems, programproducts, and methods of using and generating each, which include and/orimplement some or all of the actions described herein. The illustrativeaspects of the invention are designed to solve one or more of theproblems herein described and/or one or more other problems notdiscussed.

BRIEF DESCRIPTION OF THE DRAWINGS

These and other features of the disclosure will be more readilyunderstood from the following detailed description of the variousaspects of the invention taken in conjunction with the accompanyingdrawings that depict various aspects of the invention.

FIG. 1 shows an illustrative environment for presenting surveillancedata for an area according to an embodiment.

FIGS. 2A-B show illustrative processes that can be implemented by theenvironment of FIG. 1 according to embodiments.

FIG. 3 shows an illustrative user interface for displaying merchandisereturn events according to an embodiment.

FIG. 4 shows an illustrative user interface for displaying statisticaldata for merchandise return events according to an embodiment.

FIGS. 5A-B show illustrative user interfaces for conducting peoplesearches according to an embodiment.

FIG. 6 shows an illustrative chart of an amount of time between entryand the merchandise return according to an embodiment.

It is noted that the drawings are not to scale. The drawings areintended to depict only typical aspects of the invention, and thereforeshould not be considered as limiting the scope of the invention. In thedrawings, like numbering represents like elements between the drawings.

DETAILED DESCRIPTION OF THE INVENTION

As indicated above, aspects of the invention provide a solution in whichmultiple event types are monitored for events, and surveillance data isstored for each event. Surveillance data for a primary event of oneevent type can be presented to a user, and surveillance data for a setof related events corresponding to another event type can be presentedbased on a set of relatedness criteria and the surveillance data for theprimary event. A user can adjust the relatedness criteria tofilter/adjust the surveillance data presented for the related event(s).A user interface can enable the user to simultaneously view thesurveillance data for both events and adjust the relatedness criteria.In an illustrative application, the invention is utilized to detectfraudulent merchandise returns in a retail store. As used herein, unlessotherwise noted, the term “set” means one or more (i.e., at least one)and the phrase “any solution” means any now known or later developedsolution.

Turning to the drawings, FIG. 1 shows an illustrative environment 10 forpresenting surveillance data for an area according to an embodiment. Tothis extent, environment 10 includes a computer system 20 that canperform a process described herein in order to monitor the area. Inparticular, computer system 20 is shown including a surveillance program30, which makes computer system 20 operable to monitor the area byperforming a process described herein.

Computer system 20 is shown including a processing component 22 (e.g.,one or more processors), a storage component 24 (e.g., a storagehierarchy), an input/output (I/O) component 26 (e.g., one or more I/Ointerfaces and/or devices), and a communications pathway 28. In general,processing component 22 executes program code, such as surveillanceprogram 30, which is at least partially stored in storage component 24.While executing program code, processing component 22 can read and/orwrite data to/from storage component 24 and/or I/O component 26. Pathway28 provides a communications link between each of the components incomputer system 20. I/O component 26 can comprise one or more human I/Odevices, which enable a human user 18 to interact with computer system20 and/or one or more communications devices to enable a system user 18to communicate with computer system 20 using any type of communicationslink.

In any event, computer system 20 can comprise one or more generalpurpose computing articles of manufacture (e.g., computing devices)capable of executing program code installed thereon. As used herein, itis understood that “program code” means any collection of instructions,in any language, code or notation, that cause a computing device havingan information processing capability to perform a particular functioneither directly or after any combination of the following: (a)conversion to another language, code or notation; (b) reproduction in adifferent material form; and/or (c) decompression. To this extent,surveillance program 30 can be embodied as any combination of systemsoftware and/or application software. Further, surveillance program 30can be implemented using a set of modules 32. In this case, a module 32,when embodied in a tangible medium of expression, can comprise acomponent that enables computer system 20 to perform a set of actionsused by surveillance program 30, and can be separately developed and/orimplemented from other portions of development program 30. To thisextent, surveillance program 30 can comprise multiple program products,which can be separately developed and/or implemented, and integrated toenable the functionality described herein. Further, it is understoodthat some of the functionality discussed herein may not be implementedor additional functionality may be included as part of computer system20.

When computer system 20 comprises multiple computing devices, eachcomputing device can have only a portion of surveillance program 30installed thereon (e.g., one or more modules 32). However, it isunderstood that computer system 20 and surveillance program 30 are onlyrepresentative of various possible equivalent systems that may perform aprocess described herein. To this extent, in other embodiments, thefunctionality provided by computer system 20 and surveillance program 30can be at least partially implemented by one or more components thatinclude any combination of general and/or specific purpose hardware withor without program code. In each embodiment, the hardware and programcode, if included, can be created using standard engineering andprogramming techniques, respectively.

Regardless, when computer system 20 includes multiple computing devices,the computing devices can communicate over any type of communicationslink. Further, while performing a process described herein, computersystem 20 can communicate with one or more other computer systems usingany type of communications link. In either case, the communications linkcan comprise any combination of various types of wired and/or wirelesslinks; comprise any combination of one or more types of networks; and/orutilize any combination of various types of transmission techniques andprotocols.

As discussed herein, surveillance program 30 enables computer system 20to monitor an area. In an illustrative implementation that is describedherein, the area is an interior of a retail store. In this case, a setof sensors 12 can include image sources (e.g., video, still frame, orthe like), audio sensors, motion sensors, etc. Further, the retail storecan include a set of point of sale (POS) terminals 14, one of which canbe designated for merchandise returns and other customer service-relatedevents.

Various aspects of the retail store implementation are shown anddescribed primarily with respect to surveillance data 40 that includessensor data 42 (e.g., image data) and transaction data 44. Regardless,in an embodiment, a retail store includes multiple image sources(sensors 12) that acquire a series of images (still frames and/or video)for different areas within the retail store, which are stored as sensordata 42. For example, the retail store can include at least one imagesource for each entrance and at least one image source for each POSterminal 14, including at least one image source for the POS terminal 14designated for returns/customer service.

FIG. 2A shows an illustrative operation of environment 10 according toan embodiment. Referring to FIGS. 1 and 2A, during operation, sensor(s)12 and POS terminal(s) 14 generate sensor data 42 and transaction data44, respectively. In process 102, computer system 20 receives sensordata 42 from sensor(s) 12, and in process 104, computer system 20receives transaction data 44 from POS terminal(s) 14. In process 106,computer system 20 analyzes sensor data 42 and transaction data 44 andassociates sensor data 42 and transaction data 44 that are related. Forexample, computer system 20 can receive transaction data 44 for a POSevent (e.g., sale, return, or the like) that occurs at a POS terminal14. Computer system 20 can store transaction data 44 on the POS event(e.g., amount, date/time, cashier, location, receipt available?, etc.)and store it as surveillance data 40. Further, computer system 20 canassociate the corresponding sensor data 42 obtained from the sensor(s)12 that capture sensor data 42 for the corresponding POS terminal 14.

Still further, computer system 20 can associate sensor data 42 thatcorresponds to other actions of the customer while in the retail store,including, for example, entry into the store, location in an aisle, etc.For example, multiple observations of a person can be obtained from aninitial observation of the person (e.g., when entering a store or whenmaking a purchase/return) as described in the co-owned, co-pending U.S.patent application Ser. No. 11/454,819, which was previouslyincorporated by reference. In this case, each observation can beassociated with the POS event.

Computer system 20 can collectively store all of the sensor data 42 andrelated transaction data 44 as a record for the POS event insurveillance data 40 using any solution. To this extent, in process 108,computer system 20 can index the data for the POS event using severalsearchable criteria, including for example, date/time of sale, cashier,register, dollar amount, purchased item(s), and/or the like. Further,additional data, such as an amount of time between entry and the POSevent, feature(s) of the customer, location(s) of the customer in theretail store, and/or the like, can be stored and made searchable, whenavailable. Regardless, in order to help ensure accurate data for the POSevent, computer system 20 can periodically synchronize the dates/timesof each sensor 12 and POS terminal 14 using any solution.

As shown in FIG. 1, computer system 20 can manage a user interface 16,which enables a user 18 to view and analyze surveillance data 40.Illustrative user interfaces are shown and described for monitoringmerchandise returns at a retail store in which image data captured by animage sensor 12 for the POS terminal 14 is associated with transactiondata 44 for the merchandise return. However, it is understood that thisapplication, and the user interfaces shown herein, are only illustrativeof numerous types of applications and user interfaces that can beimplemented under aspects of the invention.

FIG. 3 shows an illustrative user interface 50 for displayingmerchandise return events, which can be generated by computer system 20and provided for presentation to user 18, according to an embodiment. Ingeneral, user interface 50 can present a scrollable (when necessary)listing of all return events for a designated time period for a retailstore. As shown, various data for each return event, such as adate/time, transaction number, transaction type, object(s) returned,value(s), register number, associate (cashier), supervisor, reason,and/or the like, can be displayed in user interface 50. It is understoodthat various additional/alternative data, such as tender and/or refundmethod, original purchase transaction data (when receipt is available),and/or the like, can be displayed in user interface 50.

User interface 50 includes a search area that enables user 18 toselectively limit the types of POS event records that are displayed inuser interface 50. For example, user 18 can use user interface 50 todesignate a particular time frame (e.g., date and/or hours), limit thedata to a particular POS terminal 14 (register), specify other searchcriteria (e.g., price range, SKU, associate, item name), and/or thelike. In addition, each of the records, values for a field in therecords, and field headings in user interface 50 can enable user 18 toadjust the data, obtain a different view of the data (re-sorted orfiltered), and/or the like, based on any number of criteria. Forexample, by clicking on a field heading (e.g., value) the records can besorted according to their corresponding values for the field. Similarly,by clicking on a particular value of a record for a field (e.g.,associate ID/name), the records can be limited to only those recordsthat have the same value. Illustrative criteria include selecting POSevents by: type, e.g., to evaluate only returns versus the other typesof POS events; register number, e.g., to extract only customer serviceregister(s); associate name/ID, e.g., to evaluate the actions of aparticular associate suspected of “sweet hearting” or assisting acustomer in carrying out fraud or to isolate a POS event reported by theassociate; value, e.g., to limit analysis to certain high value (andtherefore potentially high loss) POS events; item name/SKU; time ofoccurrence; and/or the like. In this manner, user interface 50 providesa rich interface to browse and search the various POS events.

Additionally, user interface 50 can enable user 18 to alternate betweenvarious display formats for the POS event records. For example, FIG. 4shows an illustrative user interface 52 for displaying statistical datafor merchandise return events, which can be generated by computer system20 and provided for presentation to user 18, according to an embodiment.In this case, user interface 52 displays the statistical data in theform of a histogram, in which a number of returns for a given day aregrouped by hour. It is understood that use of a histogram is onlyillustrative, and any grouping and/or statistical presentation methodcan be utilized. As with user interface 50 (FIG. 3), user interface 52can enable user 18 to designate various search/filter criteria, whichcan be applied to generate the histogram.

Further, the histogram can enable user 18 to drill down into theunderlying data. For example, clicking on a bar may generate statisticaldata for a narrower time frame. To this extent, in response to clickingon a bar that represents a day's transactions, computer system 20 maygenerate a user interface 52 that includes a histogram of that day'stransactions broken down by hour. Alternatively, by clicking on aparticular bar in the histogram, e.g., when the bar represents a minimaltime frame (e.g., one hour) or a minimal number of transactions (e.g.,less than 100), computer system 20 can generate user interface 50 todisplay the records for the events that correspond to the bar in thehistogram.

Returning to FIG. 3, user interface 50 also includes columns 54A-C foreach POS event record that enable user 18 to request to view image datacorresponding to the POS event, if available. For example, in responseto user 18 clicking on an icon in column 54A for a POS event record,computer system 20 can present image data (one or more still imagesand/or a video) for the POS terminal 14 where and when the POS eventoccurred. In response to user 18 clicking on an icon in column 54B for aPOS event record, computer system 20 can present image data for thecustomer at the retail store (e.g., at the POS terminal 14, entrance,aisle(s), and/or the like), if available. Additionally, in response touser 18 clicking on an icon in column 54C for a POS event record,computer system 20 can generate a new interface that enables user 18 toview and analyze image data acquired around the time of the POS event.

To this extent, FIG. 5A shows an illustrative user interface 60A forconducting people searches, which can be generated by computer system 20and provided for presentation to user 18, according to an embodiment.User interface 60A includes a first panel 62A for displayingsurveillance data 40 for a first set of monitored events, in this case,customer returns, and a second panel 64A for displaying surveillancedata 40 for another set of monitored events, in this case, customerentrances into a retail store. However, it is understood that customerreturns and customer entrances are only illustrative events, and userinterface 60A can be used to display surveillance data 40 for events ofany combination of two or more distinct monitored event types.Regardless, user interface 60A includes a third panel 66A, whichincludes various user interface controls for enabling user 18 todesignate settings that apply surveillance data 40 to be displayed inboth panels 62A, 64A. Additionally, each panel 62A, 64A includes userinterface control(s) that enable user 18 to designate settings that areapplicable only to surveillance data 40 displayed in the correspondingpanel 62A, 64A. Additional user interface features can be included inuser interface 60A. For example, by moving a mouse over an image, candisplay an alternative frame (e.g., zoom in is displayed by default, andthe full frame is displayed when the cursor pauses over the image),additional surveillance data 40 (e.g., a duration of an event, such ashow long a face was visible), and/or the like.

When computer system 20 generates user interface 60A in response to user18 clicking on an icon in column 54C (FIG. 3), user 18 may be seeking todetermine if the POS event, in this case a merchandise return, wasfraudulent. As a result, panel 62A can display image data that wascaptured for the POS terminal 14 at which the POS event occurred, at atime of the POS event and a time frame prior to the POS event. In thismanner, panel 62A can display a series of images that correspond to thePOS event. Computer system 20 can determine what image(s) to display inpanel 62A using any solution. For example, computer system 20 candisplay a last image captured prior to the POS event, and imagescaptured every N seconds prior to the last image. Alternatively,computer system 20 can perform image processing to select a set ofimages for display in panel 62A that provide the best data (e.g.,clearest image of the customer's face).

One approach to acquiring additional information regarding an event, isto analyze other events that may be related to the event. For example,when monitoring a retail store, computer system 20 can monitor otherevent types in addition to POS events, such as, customer entries/exitsto/from the store, customer presence in an aisle, removal of an itemfrom a shelf, an item breaking, and/or the like. To this extent, a userthat is seeking to analyze whether a merchandise return was fraudulent,could analyze customer entries into the store (to ensure that thecustomer entered the store with the merchandise), customer presence inan aisle (e.g., to determine whether the customer went to the aislewhere the item is sold), item removal from a shelf (e.g., to determineif the customer removed the item from the shelf and presented it forstore credit), and/or the like. For example, computer system 20 candisplay surveillance data for customer entry events into the retailstore in panel 64A.

Additionally, computer system 20 can limit the analysis of the otherevents to a subset of these other monitored events based on a set ofrelatedness criteria. For example, when analyzing a merchandise return,only those customer entries that preceded the return can be analyzed.Similarly, computer system 20 can use other relatedness criteria, suchas facial recognition, clothing color, time between two events, and/orthe like, to limit the related event(s) that are presented for analysis.

When analyzing merchandise returns, computer system 20 can limit thesurveillance data for customer entry events provided in panel 64A to atime period that immediately precedes the merchandise return. Inparticular, FIG. 6 shows an illustrative chart of an amount of timebetween entry and the merchandise return according to an embodiment. Asillustrated, approximately 65% of the customers make the return withinfour minutes of entering the store. However, it is expected that veryfew fraudulent returns would be completed within four minutes ofentering the store (e.g., since the individual must first go and obtainthe item(s) from the store shelves). As a result, by default, computersystem 20 can limit the surveillance data 40 for customer entry eventsto the preceding four minutes.

Alternatively, computer system 20 can manage a user interface 60A thatis provided to a cashier/associate for use in real time evaluation ofpotential fraud, such as a merchandise return. To this extent, FIG. 2Bshows an illustrative process that can be implemented by environment 10according to an embodiment, and FIG. 5B shows an alternative userinterface 60B for conducting people searches, which can be generated bycomputer system 20 and provided for presentation to user 18, accordingto an embodiment. Similar to user interface 60A, user interface 60Bincludes panels 62B, 64B for displaying surveillance data 40 for twodistinct monitored events, and a panel 66B, which enables a user 18 toselectively alter the surveillance data 40 displayed in panels 62B, 64B.

In process 202, computer system 20 can provide surveillance data for anevent type of interest for presentation to user 18. For example, eachtime computer system 20 detects a new individual approaching a customerservice/returns counter, computer system 20 can update panel 62B on userinterface 60B with surveillance data 40 of the individual. Subsequently,in process 204, the user 18 (e.g., a cashier at the customerservice/returns counter) can select the surveillance data 40 of aparticular individual for analysis, which can be received by computersystem 20.

In process 206, computer system 20 can provide surveillance data 40 forrelated events of another event type for presentation to user 18 using aset of default relatedness criteria. For example, computer system 20 canprovide surveillance data 40 for customer entry events into the retailstore in panel 64B. By default, computer system 40 can limit thecustomer entry events for which surveillance data 40 is provided to onlythose that occurred within a specified number of minutes before theselected event. In process 208, computer system 20 can determine whetheruser 18 has selected to change any of the set of relatedness criteria.If so, then in process 210, computer system 20 can adjust/filter theevents for which surveillance data 40 is presented to user 18. Forexample, user 18 can adjust the time frame, limit the events to aparticular location in the store (e.g., a single entrance), limit theevents having one or more attributes (e.g., visual features, such ascolor of clothing, facial recognition, and/or the like), etc.

Regardless, user 18 can direct the analysis until he/she indicates thathe is done in process 212. In an embodiment, while user 18 is reviewingthe surveillance data 40 in processes 206, 208, 210, user 18 canindicate whether any surveillance data 40 for the related events wasfound that matches/corresponds to the selected event. If so, computersystem 20 can store that the two or more corresponding events arerelated for future reference. In any event, once user 18 has completedhis/her analysis, the process can return to process 202 until user 18selects another event.

As a result, aspects of the invention provide an improved solution forintegrating multiple event analysis using surveillance data and/ortransaction data to improve, for example, fraud detection in a retailstore. To this extent, aspects of the invention use video/image analysisto index image data and/or transaction data, enabling ready retrieval ofsurveillance data 40 for events of interest using a variety of cues. Inthis manner, aspects of the invention provide an improved solution forperforming post-event analysis (e.g., reviewing merchandise returns forfraudulent activity) and real time analysis (e.g., reviewing customerentries to ensure presented return is valid). Such analysis can enable:(1) increased use of video due to more feasible, automated searching;(2) lower search costs (computer implemented vs. manual); and (3)increased search accuracy by removing some human error andinattentiveness.

In the retail environment, fraudulent claims can be defeated/shown byvideo demonstration. To this extent, numerous fraudulent scenarios canbe defeated, such as: (1) return of merchandise using valid receipt, butitem newly retrieved from store; (2) return of item newly retrieved fromstore without receipt; (3) false accident claim (can determine ifaccident took place, identify actions inconsistent with an accident);(4) negligent behavior leading to an accident; and/or the like. Whileprimarily shown and described within the retail environment, it isunderstood that aspects of the invention can be applied equally to manydifferent environments including, for example, public transportation,public facilities, streets, and/or the like.

While shown and described herein as a method and system for presentingsurveillance data for an area, it is understood that aspects of theinvention further provide various alternative embodiments. For example,in one embodiment, the invention provides a computer program stored onat least one computer-readable medium, which when executed, enables acomputer system to monitor an area. To this extent, thecomputer-readable medium includes program code, such as surveillanceprogram 30 (FIG. 1), which implements some or all of a process describedherein. It is understood that the term “computer-readable medium”comprises one or more of any type of tangible medium of expressioncapable of embodying a copy of the program code (e.g., a physicalembodiment). For example, the computer-readable medium can comprise: oneor more portable storage articles of manufacture; one or morememory/storage components of a computing device; a modulated data signalhaving one or more of its characteristics set and/or changed in such amanner as to encode information in the signal; paper; and/or the like.

In another embodiment, the invention provides a method of generating asystem for presenting surveillance data for an area. In this case, acomputer system, such as computer system 20 (FIG. 1), can be obtained(e.g., created, maintained, made available, etc.) and one or moreprograms/systems for performing a process described herein can beobtained (e.g., created, purchased, used, modified, etc.) and deployedto the computer system. To this extent, the deployment can comprise oneor more of: (1) installing program code on a computing device from acomputer-readable medium; (2) adding one or more computing devices tothe computer system; and (3) incorporating and/or modifying the computersystem to enable it to perform a process described herein.

It is understood that aspects of the invention can be implemented aspart of a business method that performs a process described herein on asubscription, advertising, and/or fee basis. That is, a service providercould offer to monitor an area as described herein. In this case, theservice provider can manage (e.g., create, maintain, support, etc.) acomputer system, such as computer system 20 (FIG. 1), that performs aprocess described herein for one or more customers. In return, theservice provider can receive payment from the customer(s) under asubscription and/or fee agreement, receive payment from the sale ofadvertising to one or more third parties, and/or the like.

The foregoing description of various aspects of the invention has beenpresented for purposes of illustration and description. It is notintended to be exhaustive or to limit the invention to the precise formdisclosed, and obviously, many modifications and variations arepossible. Such modifications and variations that may be apparent to anindividual in the art are included within the scope of the invention asdefined by the accompanying claims.

1. A method of presenting surveillance data for an area, the methodcomprising: providing primary surveillance data for a set of primaryevents corresponding to one of a plurality of monitored event types forpresentation to a user; obtaining a selected event from the set ofprimary events and a corresponding set of relatedness criteria;identifying a set of related events corresponding to another one of theplurality of monitored event types based on the surveillance data forthe selected event and the set of relatedness criteria; and providingrelated surveillance data for each related event for presentation to theuser.
 2. The method of claim 1, wherein the related surveillance dataincludes image data, the method further comprising: obtaining a visualfeature; and filtering the related surveillance data for the set ofrelated events based on the visual feature and the image data.
 3. Themethod of claim 1, further comprising: obtaining a set of related imagesources; and adjusting the related surveillance data for the set ofrelated events to only include related surveillance data acquired by theset of related image sources.
 4. The method of claim 1, wherein thesurveillance data for the set of primary events only includessurveillance data acquired by a designated subset of a plurality ofprimary sensors.
 5. The method of claim 1, further comprising:generating a transaction user interface for displaying transaction datacorresponding to the set of primary events and enabling the user torequest to view image data corresponding to at least one of the set ofprimary events; and providing the transaction user interface forpresentation to the user.
 6. The method of claim 1, wherein the set ofprimary events are merchandise returns at a retail store and the set ofrelated events are customer entrances to the retail store.
 7. The methodof claim 6, further comprising: receiving sensor data and transactiondata for the retail store, the transaction data including data on atleast one POS event; associating at least some of the sensor data witheach of the at least one POS events; and storing the transaction dataand associated sensor data as surveillance data for the POS event.
 8. Asystem for presenting surveillance data for an area, the systemcomprising: a component for providing primary surveillance data for aset of primary events corresponding to one of a plurality of monitoredevent types for presentation to a user; a component for obtaining aselected event from the set of primary events and a corresponding set ofrelatedness criteria; a component for identifying a set of relatedevents corresponding to another one of the plurality of monitored eventtypes based on the surveillance data for the selected event and the setof relatedness criteria; and a component for providing relatedsurveillance data for each related event for presentation to the user.9. The system of claim 8, wherein the related surveillance data includesimage data, the system further comprising: a component for obtaining avisual feature; and a component for filtering the related surveillancedata for the set of related events based on the visual feature and theimage data.
 10. The system of claim 8, further comprising: a componentfor obtaining a set of related image sources; and a component foradjusting the related surveillance data for the set of related events toonly include related surveillance data acquired by the set of relatedimage sources.
 11. The system of claim 8, further comprising: acomponent for generating a transaction user interface for displayingtransaction data corresponding to the set of primary events and enablingthe user to request to view image data corresponding to at least one ofthe set of primary events; and a component for providing the transactionuser interface for presentation to the user.
 12. The system of claim 8,wherein the set of primary events are merchandise returns at a retailstore and the set of related events are customer entrances to the retailstore.
 13. The system of claim 12, further comprising: a component forreceiving sensor data and transaction data for the retail store, thetransaction data including data on at least one POS event; a componentfor associating at least some of the sensor data with each of the atleast one POS events; and a component for storing the transaction dataand associated sensor data as surveillance data for the POS event.
 14. Acomputer program comprising program code stored on a computer-readablemedium, which when executed, enables a computer system to implement amethod of presenting surveillance data for an area, the methodcomprising: providing primary surveillance data for a set of primaryevents corresponding to one of a plurality of monitored event types forpresentation to a user; obtaining a selected event from the set ofprimary events and a corresponding set of relatedness criteria;identifying a set of related events corresponding to another one of theplurality of monitored event types based on the surveillance data forthe selected event and the set of relatedness criteria; and providingrelated surveillance data for each related event for presentation to theuser.
 15. The computer program of claim 14, wherein the relatedsurveillance data includes image data, the method further comprising:obtaining a visual feature; and filtering the related surveillance datafor the set of related events based on the visual feature and the imagedata.
 16. The computer program of claim 14, the method furthercomprising: obtaining a set of related image sources; and adjusting therelated surveillance data for the set of related events to only includerelated surveillance data acquired by the set of related image sources.17. The computer program of claim 14, the method further comprising:generating a transaction user interface for displaying transaction datacorresponding to the set of primary events and enabling the user torequest to view image data corresponding to at least one of the set ofprimary events; and providing the transaction user interface forpresentation to the user.
 18. The computer program of claim 14, whereinthe set of primary events are merchandise returns at a retail store andthe set of related events are customer entrances to the retail store.19. The computer program of claim 18, the method further comprising:receiving sensor data and transaction data for the retail store, thetransaction data including data on at least one POS event; associatingat least some of the sensor data with each of the at least one POSevents; and storing the transaction data and associated sensor data assurveillance data for the POS event.
 20. A method of generating a systemfor presenting surveillance data for an area, the method comprising:providing a computer system operable to: provide primary surveillancedata for a set of primary events corresponding to one of a plurality ofmonitored event types for presentation to a user; obtain a selectedevent from the set of primary events and a corresponding set ofrelatedness criteria; identify a set of related events corresponding toanother one of the plurality of monitored event types based on thesurveillance data for the selected event and the set of relatednesscriteria; and provide related surveillance data for each related eventfor presentation to the user.